(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 

Internationa] Bureau 

(43) International Publication Date 
12 July 2001 (12.07.2001) 




PCT 



liiiiiiniiiiiiMHiii 

(10) International Publication Number 

WO 01/50409 Al 



(51) International Patent Classification 7 : G06K 9/00, 9/36, 
9/40, 9/03, 9/20, 7/10, H04L 9/00, B42D 15/00 

(21) International Application Number: PCT/US0<y34942 

(22) International Filing Date: 

22 December 2000 (22.12.2000) 



(25) Filing Language: 

(26) Publication Language: 



English 
English 



(30) Priority Data: 

60/173,880 31 December 1999 (31.12.1999) US 

(71) Applicant: D1G1MARC CORPORATION [US/US}; 
Suite 250, 19801 SW 72nd Avenue, Tualatin, OR 97062 
(US). 

(72) Inventors: DAVIDSON, Clay; 17374 Lake Haven Drive, 
Lake Oswego, OR 97035 (US). REED, A lasts ir; 555 Sixth 
Street, Lake Oswego, OR 97035 (US). SHEN, Lain; Apt 
E-204, 6805 SW Nyberg Road, Tualatin, OR 97062 (USX 
CATTONE, Jeremy; 1431 8 SW Chesterfield Lan., Tigard, 
OR 97224 (US). 



(74) Agent: GALBI, Elmer; 13314 Vermeer Drive, Lake Os- 
wego, OR 97035 (US). 

(81) Designated States (national): AE, AG, AL, AM, AT, AU, 
AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CR, CU, CZ, 
DE, DK, DM, DZ, EE, ES, FI, GB, GD, GE, GH, GM, HR, 
HU, ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, LC, LK, LR, 
LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, MX, MZ, 
NO, NZ, PL, PT, RO, RU, SD, SE, SG, SI, SK, SL, TJ, TM, 
TR, TT, TZ, UA, UG t UZ, VN, ZA, ZW 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European 
patent (AT, BE, CH, CY, DE, DK, ES, FI, FR, GB, GR, IE, 
IT, LU, MC, NL, PT, SE, TR), OAPI patent (BF, BJ, CF, 
CG, a, CM, GA, GN, GW, ML, MR, NE, SN, TD, TG). 

Published: 

— With international search report 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



(54) Title: COMPENSATING FOR COLOR RESPONSE AND TRANSFER FUNCTION OF SCANNER AND/OR PRINTER 
WHEN READING A DIGITAL WATERMARK 



TWWNMKtKCS 

20 



HaRtowe Dcpendwt K> Layw 
(SCSI. Parafei, Serf* etc) 





r — 

MlSOUKt 


AppfioiM L^ 


OMiSoiRt 

Mraor 





4 




< 
o 

IT) 
l-H 

O 



(57) Abstract: Watermark and pattern detection can be improved by compensating for artefacts introduced into an image by a printer 
and/or scanner through which the image has passed (24). With the present invention, prior to watermark or pattern detection, the 
image is filtered or modified to compensate for artefacts introduced by the printer and/or scanner. User is provided with an interface 
which can be used to change certain parameters such as contrast and intensity (23). The changes made by the user change the 
compensation (i.e. the tone map) applied to the image. If the user changes the compensation applied to the image it can affect the 
ability to read the watermark. The present invention provides a system which reverses any compensation introduced by the user so 
that the watermark or pattern can be more easily read (25). In another embodiment the invention takes into consideration that some 
printers and scanners have transfer functions which differ in the "x" and "y" directions. Thus the compensation introduced by the 
filter can differ in the H x" and "y H directions. In one embodiment, a scanner introduces aliasing frequencies into an image. Detection 
is improved by selectively removing certain frequencies. In another embodiment, the filter compensates for fact that the scanner 
frequency response falls off at higher frequencies. 
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I 

2 Compensating for Color Response and Transfer Function of 

3 Scanner and/or Printer When Reading a Digital Watermark 

4 

5 Field of the Invention: 

6 The present invention relates to steganography and more particularly to reading digital 
7' watermarks. 

8 

9 Background of the Invention : 

10 The technology for inserting digital watermarks in digital images and for reading digital 

1 1 watermarks from digital images is well developed. There are many issued patents and 

12 published technical papers which explain the technology for reading watermarks. 

13 

14 Frequently after a digital watermark has been inserted into a digital image, the image 

15 is printed and later the printed image is scanned to create a new digital image. 

16 However, printers and scanners do not precisely reproduce images. That is, printers 

17 and scanners introduce anomalies, distortions and changes into an image as it is 

18 being printed or scanned. The typical operations which are performed on 

19 watermarked images are illustrated in Figures 1A and 1B. 

20 

2 1 The process begins with a digital image 10A. An image editing program 1 1 is used to 

22 insert a digital watermark into the image. For example a watermark may be inserted 

23 into the image 1 0A by the watermark program which is part of the commercially 

24 available image editing program marketed by Adobe Corporation under the trademark 

25 "Adobe Photoshop". Next, a printer 12 is used to create a physical image 10B which 

26 includes a digital watermark. 

27 

28 Next as illustrated in Figure 1B, the physical image 10B is passed through a scanner 

29 13 to generate a digital image 10C. The digital image is then processed by a 

30 watermark detection program 14 to detect the watermark. For example the watermark 

3 1 may be detected by the watermark detection program which is part of the commercially 

32 available image editing program marketed by Adobe Corporation under the trademark 

33 "Adobe Photoshop". 
34 

35 Printer 12 and the scanner 13 generally do not have a perfect color response and they 

36 have transfer functions which is other than unity. That is, they introduce anomalies, 
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1 distortions or changes into the image. For example, with some scanners, if a printed 

2 image is scanned and then displayed, the appearance of the displayed image will not 

3 be identical appearance to the hard copy image. Likewise, with some printers, if a 

4 digital image is printed, the printed image will not appear to be identical to a display of 

5 the original digital image. As used herein the term scanner is used to mean 

6 conventional flatbed and sheet feed scanners as well as other image acquisition 

7 devices such as digital cameras. Anomalies, distortions or changes introduced into an 

8 image by a printer or scanner are hereinafter collectively referred to as "artifacts*. 

9 Such artifacts may interfere with the operation of the watermark detection program 13 

10 or with programs used to detect patterns or geometric shapes in an image, 
n 

12 Some watermark or pattern detection programs compensate for scale and rotation of 

13 an image. However, the prior art watermark and pattern detection programs do not 

14 adequately compensate for artifacts introduced into an image by a printer or scanner. 

1 5 Such artifacts can make detection of a digital watermark or pattern difficult if not 

16 impossible. This is particularly true when such artifacts are coupled with other 

17 changes such as scaling, rotation and wear and tear. 

18 

19 Summary of the Invention: 

20 Watermark and pattern detection can be improved by compensating for artifacts 

21 introduced into an image by a printer and/or scanner through which the image has 

22 passed. With the present invention, prior to watermark or pattern detection, the image 

23 is filtered or modified to compensate for artifacts introduced by the printer and/or 

24 scanner. 
25 

26 Some scanners automatically compensate for artifacts introduced by the scanner by 

27 using a calibrated tone map. The automatic compensation provides an image from 

28 which, a watermark can be easily read. However, generally the user is provided with 

29 an interface which can be used to change certain parameters such contrast and 

30 intensity. The changes made by the user change the compensation (i.e. the tone 

3 1 map) applied to the image, tf the user changes the compensation applied to the image 

32 it can affect the ability to read the watermark. The present invention provides a system 

33 which reverses any compensation introduced by the user so that the watermark or 

34 pattern can be more easily read. 

35 
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1 In another embodiment the invention takes into consideration that some printers and 

2 scanners have transfer functions which differ in the V and "y w directions. Thus the 

3 compensation introduced by the fitter can differ in the V and V directions. In one 

4 embodiment, a scanner introduces aliasing frequencies into an image. Detection is 

5 improved by selectively removing certain frequencies. In another embodiment, the 

6 filter compensates for fact that the scanner frequency response falls off at higher 

7 frequencies. 
8 

9 Brief Description of the Figures: 

10 Figures 1 A and 1 B show the process used in the prior art. 

1 1 Figure 2 illustrates a preferred embodiment of the invention using TWAIN interface. 

12 Figures 3A and 3B are flow diagrams illustrating the operation of the present invention. 

13 Figure 3C shows the change in Gamma curve due to user setting. 

14 Figures 4A and 4B show the process used in an alternate embodiment of the present 

15 invention. 

16 Figure 5A, 5B and 5C are used to describe an alternate embodiment of the invention. 

17 Figure 6 illustrates a technique for detecting the transfer function of a scanner and 

18 printer. 

19 

20 Detailed Description of embodiments of the invention: 

21 The preferred embodiment of the invention described herein utilizes the invention to 

22 facilitate detecting and reading a digital watermark from an image. As explained later, 

23 the invention can also be used to facilitate the operation of other types of image 

24 analysis programs such as programs that detection geometric shapes, logos or other 

25 patterns. It is also noted that the preferred embodiment utilizes a scanner as an 

26 image acquisition device. Other types of image acquisition devices such as digital 

27 cameras could also be used with the present invention. 

28 

29 The first preferred embodiment of the present invention is shown in Figure 2. The 

30 system shown in Figure 2 includes a computer 30 and a scanner 24. In the particular 

31 embodiment described herein the scanner 24 is the Hewlett-Packard ScanJet model 

32 6300c scanner (hereinafter HP 6300). The computer 30 can be a personal computer 

33 operating under the Microsoft Windows operating system. 

34 

35 The computer 30 includes an application program 21 , and a watermark reading 

36 program 26. The application program 21 may, for example, be an image editing 
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1 program such as "Adobe Photoshop" which is marketed by Adobe Corporation of San 

2 Jose California. The watermark reading program 26 may for example be similar to the 

3 watermark reading program which is included as a part to the Adobe PhotoShop 

4 program; however, as used here the watermark reading program 26 is separate from 

5 the application program 21 . 
6 

7 The HP 6300 scanner uses what is known in the art as a "TWAIN" interface. The 

8 application program 21 is connected to a scanner 24 using a TWAIN interface 20. The 

9 TWAIN interface was developed by the TWAIN Working Group and it provides a 

10 standard software protocol and application programming interface (API) that regulates 

1 1 communication between software applications and imaging devices such as scanners. 
12 

13 Two key elements in a system that uses the TWAIN interface are the source manager 

14 software and the data source software. These elements are described in detail in the 

15 TWAIN specification which is available on the Internet at a site maintained by the 

16 TWAIN organization. This site can be located by doing an Internet search under the 

1 7 name TWAIN. The TWAIN specifications version 1 .9 as ratified by the TWAIN 

18 working group on January 20, 2000 is hereby incorporated herein by reference. 

19 

20 As shown in Figure 2, the system includes data source manager software 22 data 

21 source software 23. The data source manager software 22 is a widely available 

22 program which provides an interface to a wide variety of imaging devices. The data 

23 source program 23 and the application program 21 have a TWAIN compliant interface 

24 to the data source manager 22. The data source program 23 provides a hardware 

25 dependent connection to the scanner 24. The HP 6300 is provided to users with a 

26 data source program which has a user interface, a TWAIN interface and a hardware 

27 interface to scanner 24. It should be appreciated that the invention can be applied to a 

28 large number of similar scanners. The present invention provides a modified data 

29 source program 23. Only those parts of the data source program 23 that are relevant 

30 to the present invention will be described herein. The remaining parts of the data 

3 1 source program 23 are conventional. 
32 

33 The data source software 23 communicates with the scanner 24 using a Scanner 

34 Control Language (SCL). This SCL language is described in a manual entitled 

35 "Scanner Control Language (SCL) and C Language Library for Hewlett-Packard 

36 Scanners v 1 1.0" which is published and distributed by Hewlett-Packard Corporation. 
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1 This manual is hereby incorporated herein in its entirety and is hereinafter referred to 

2 as the scanner SCL Manual. Only those parts of data source program 23 that are 

3 relevant to the present invention are described herein. 

4 

5 A user interface provided by data source program 23 allows a user to change the tone 

6 and contrast of the image produced by scanner 24. The present invention is directed 

7 to insuring that changes made by the user do not interfere with the operation of the 

8 watermark detection program 26. 
9 

10 The scanner 24 includes a mechanism for providing a Gamma correction to the 

1 1 scanned image. The Gamma correction curve (i.e. an adjustment for the luminosity of 

12 each pixel in a scanned image) is controlled by a tone map which can be downloaded 

13 into the scanner by the data source program 23. In the scanner 24, the RGB values 

14 for each pixel are first adjusted in accordance the values in a 3 by 3 matrix which 

15 adjusts each color based on the values of the other colors of that pixel. Next the 

16 luminance value of each pixel is adjusted in accordance with a Gamma curve that 

17 specifies an adjustment for each particular luminance value. The term tone map as 

18 used herein refers to the values for the 3 by 3 matrix and the values which specify an 

19 appropriate adjustment for each luminance value (that is, the Gamma curve). 

20 

21 In the following discussion reference will be made to the following three tone maps: 



22 1) Default tone map: a tone map stored in the printer that is used to adjust an 

23 image if no other tone map is provided to the printer. 

24 2) Calibrated tone map: a tone map which is generated from a test pattern and 

25 which is designed to produce, in so far as possible, a true digital 

26 representation of the scanned image. As used herein, the term a true 

27 digital representation means a digital image which when displayed 

28 appears identical to the original printed image that was scanned. A 

29 technique for generating a calibrated tone map is described later with 

30 reference to Figure 3B. 

31 3) User adjusted tone map: a tone map which is generated in response to user 

32 input to change an image so that the image has the contrast and 

33 intensity requested by the user. 

34 



35 The data source program 23 provides a conventional user interface through which a 

36 user can change the contrast and intensity of a scanned image. When a user changes 
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1 the desired contrast and intensity of an image, the calibrated tone map is changed into 

2 the user adjusted tone map so that the image will have the user specified 

3 characteristics. This is a conventional operation which is preformed by the data 

4 source program that is provided with the HP6300 scanner. 

5 

6 When an image is scanned, the resulting digital data, corrected in accordance with the 

7 user adjusted tone map, is sent to the application program 21. The data is also sent to 

8 an inverse user adjustment program 25. The inverse user adjustment program 25 

9 reverses any changes made to the image to satisfy the settings entered by the user. 

10 The output of the inverse user adjustment program 25 is a digital image that is 

1 1 identical to the digital image that would have been produced if the calibrated tone map 

12 had been applied to the image instead of the user modified tone map. The image as 

13 changed by inverse user adjustment program 25 is then sent to the watermark reading 

14 program 26. 
15 

16 The inverse user adjustment program 25 determines what changes were made to the 

17 calibrated tone map as a result of inputs from the user. Inverse user adjustment 

18 program 25 then applies the inverse of these changes to the image produced by 

19 scanner 24. The inverse user adjustment program 25 is a program that performs a 

20 inverse table look up operation. Programs to perform a inverse table look up are 

21 conventional. The action performed by inverse user adjustment program 25 is 

22 illustrated in Figure 3C. When a user adjusts the contrast setting, the shape of the 

23 Gamma curve is changed. Figure 3C illustrates what happens to the Gamma curve 

24 when the user adjusts the contrast of the image. In the example shown, the contrast 

25 setting was lowered by the user. As a result of the changes by the user the Gamma 

26 curve was changed and at the upper end (at higher intensity) the pixels are given a 

27 lower intensity than prior to the adjustment. The inverse user adjustment program 25 

28 reverses the delta created by the user settings. 
29 

30 The following example illustrates the what occurs when the calibrated tone map is 

3 1 changed into a user adjusted tone map and how the inverse user adjustment program 

32 25 operates. 

33 

34 Assume that the calibrated tone map has the following values (for convenience only a 

35 small section of the tone map is give). 
36 
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1 Calibrated tone map values: 



Input values 


251 


252 


253 


254 


255 


256 


257 


258 


259 


output values 


249 


250 


251 


252 


253 


254 


255 


256 


257 



2 

3 Let us assume that due to inputs from the user, the following user adjusted tone map 

4 is generated (again only a small portion of the map is shown). 

5 



Input values 


251 


252 


253 


254 


255 


256 


257 


258 


259 


Output values 


248 


249 


250 


251 


252 


253 


254 


255 


256 



6 

7 The inverse user adjustment program 25 would perform a reverse table look up as 

8 follows: 

9 When, for example, it receives a value of 256, it would perform a reverse table look in 

10 the User Adjusted Tone map and determine that the 256 value came from an input 

1 1 value of 259. It would then adjust this value to 257 as specified by the calibrated tone 

12 map. 
13 

14 The operation of the system is illustrated in Figures 3A and 3B. Figure 3A illustrates 

15 the normal operations that occur when an image is scanned. Figure 3B illustrates the 

16 operations that are used to generate a calibrated tone map and to initialize the system. 

17 The operations shown in Figure 3A normally take place each time the scanner is used 

18 to acquire an image. However, it should be noted that the operations illustrated in 

19 Figure 3A take place after a calibrated tone map has been generated and stored in the 

20 data source 23 using the technique illustrated in Figure 3B. . 
21 

22 The operation of the system as illustrated in Figure 3A will now be explained. As 

23 indicated by box 301 when a user wants to scan an image, the user sets the tone and 

24 intensity controls (or indicates that the defaults settings should be used). As indicated 

25 by block 302, the calibrated tone map is then changed to produce a user adjusted tone 

26 map (i.e. a tone map which will produce an image with the desired tone and intensity). 

27 

28 As indicated by block 303, the user adjusted tone map is sent to the scanner. As 

29 indicated by blocks 304 and 305, the image is then scanned and the scanner applies 

30 the user adjusted tone map to the digital data generated by the scanner. The image 

3 1 adjusted by the user adjusted image is herein termed an adjusted digital image. 
32 



-7- 



WO 01/50409 PCT/US00/34942 

1 As indicated by block 314, the adjusted digital image( i.e. the digital image with the 

2 user adjusted tone map applied) is supplied to the inverse user adjustment program 

3 25. Program 25 reverses the changes made in the tone map to satisfy the user 

4 entered tone and contrast setting. The result is that inverse user adjustment program 

5 25 produces a corrected image adjusted according to the calibrated tone map. As 

6 illustrated in Figure 3C, the inverse user adjustment program 25 changes the image 

7 such that the result of both the correction made in the scanner and the correction 

8 made by inverse user adjustment program 25 (i.e. the sum of both corrections) is the 

9 same correction as would have been made by the calibrated tone map if only it had 

10 been applied to the image. 
11 

12 As indicated by block 315 the system sends the corrected digital image produced by 

13 inverse user adjustment program 25 to watermark reading program 26 which detects 

14 and reads the watermark. The watermark reading program 26 may be a conventional 

15 watermark reading program such as that which is a part of the commercially available 

16 "Adobe PhotoShop" program. 

17 

18 The invention is directed to enhancing the ability to read a watermark. Once the 

19 watermark is read, the data obtained can be used for a large variety of purposes. For 

20 example, once the watermark is read, the data from the watermark can be merely 

2 1 supplied to an operator or possibly to another program. 

22 

23 However, as indicated by dotted blocks 316, 321, 322 and 323, in one alternate 

24 embodiment, the output of the watermark detector 29 controls what data is sent to the 

25 data source manager 22 and to the application program 21 . For example, if the 

26 watermark detector reads certain data, such as the name of the copyright owner, the 

27 name of the copyright owner along with the image corrected in accordance with the 

28 user adjusted tone map may be sent to the application program 22. Alternatively, if a 

29 different watermark is read, the image may not be sent to the application program. It 

30 can for example be used accesses a particular web site on the internet in accordance 

3 1 with the commercially available service market by Digimarc Corporation under the 

32 trademark "MediaBridge*. 
33 

34 In its simplest form the control indicated by block 316 can be implemented by a look 

35 up table that indicates what operation should be performed depending upon what 

36 particular watermark is detected. In the embodiment where the functions illustrated by 
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1 blocks 316, 322 and 323 are performed, the transfer from data source 23 to data 

2 source manager 22 would be controlled by a gating mechanism which would only 

3 transfer the data from the scanner to the data source manager 22 and thus to the 

4 application program 21 depending on the output of watermark reading program 26. 

5 Alternate connections could be provided from data source manager 22 to other 

6 applications, again dependent upon the output of watermark reading program 26. 

7 

8 In still another embodiment, the output of the inverse user adjustment program 25 is 

9 both sent to a watermark reading program and to a shape recognition program. The 

10 combined output from both of the watermark reading program and the shape 

1 1 recognition program are then used to determine which operation should be taken. 

12 

13 Figure 3B illustrates how the scanner is initialized, how the calibrated tone map is 

14 generated and how the user modified tone map is sent to the scanner. As initially 

15 installed the system uses a default tone map as indicated by block 351 . The default 

16 tone map can be a very simple tone map with a straight line relationship between input 

17 and output, that is, a straight line Gamma curve. 
18 

19 Next, a test pattern and a calibration program is used to generate the calibrated tone 

20 map. The International Color Consortium has developed a standard color calibration 

21 format. Information about the standard color calibration can be found on a web site 

22 maintained by the Color Consortium. The web site has the name "color" and the group 

23 designator "org" (note URLs are not permitted in a patent application but the URL can 

24 be easily located from the above information) 

25 

26 The calibration technique uses a standard color calibration target to create a 

27 calibration profile for the scanner. The scanner is calibrated so that when a color 

28 calibrated target is scanned, the output will be a defined RGB output which faithfully 

29 reproduces the color calibrated target. Thus two scanners from different 

30 manufacturers which have been similarly calibrated will produce similar (if not 

3 1 identical) outputs from the same image. 

32 

33 As indicated by blocks 352 and 353, a test pattern is scanned and a test image is 

34 generated using the default tone map. A calibrated tone map, (that is, a tone map 

35 which would have produced an image which faithfully reproduced the test pattern) is 

36 generated as indicated by block 354. 
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2 There are commercial programs available which can be used to generate the 

3 calibrated tone map. A number of companies including Kodak, Fuji and ColorBlind Inc. 

4 provide calibration packages. The packages can be used for calibrating scanners, 

s printers and monitors. Details of the calibration packages can be found at a web site 

6 maintained by Kodak corporation and at a web site with the name "itec" and the group 

7 designator "net" and at a web site with the name "ffei" and the designator "co.uk" 
8 

9 The calibrated tone map is stored in the data source program 23 as indicated by block 

10 355. Next when a user wants to scan an image, the user may enter desired 

1 1 parameters such tone and contrast. In the preferred embodiment, the parameters 

12 entered include only tone and contrast; however, provision could be made to allow the 

) 3 user to adjust other additional parameters. For example, the user could be allowed to 

14 set the other color parameters such as hue, or the user could be allowed to set other 

15 parameters such as X Resolution, Y Resolution, X Scale factor, Y Scale factor, etc. 
16 

17 The resolutions may be of particular interest, since if there are 'differing* resolutions or 

18 scale in the X and Y direction, it would be desirable to correct for this prior to 

19 attempting to detect the watermark. Resolution may be important since some 

20 watermark detectors cannot read watermarks if images have different resolutions in 

21 the X and Y direction. Also, if scale differs more than a few percent in X and Y it may 

22 make reading the watermark difficult However, with the present invention if an image 

23 that has different sample rates or scale applied in X and Y directions, these can be 

24 adjusted prior to the watermark or pattern detection process. 

25 

26 Some scanners also have a "Set Filter" command for the scanner that controls how 

27 several pixels in the X direction may be averaged together to create a smoothed 

28 image. This command can be used to manually control the filtering. Also, some 

29 scanners have an "Inquire Auto-Filtering" command that lets the software ask the 

30 scanner what filtering in (in the X direction) is being used when the scan is done in the 

3 1 Auto-Filter mode. With the present invention, an awareness of what type of spatial 

32 filtering is being done, and the fact that it differs in the X and Y directions, could be 

33 used to either adjust and pre-compensate prior to detection, or could affect the 

34 operation of the detection algorithms. 

35 
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1 As indicated by block 357, a user modified tone map which will produce an image with 

2 the desired characteristics is generated. The technique for generating a calibrated 

3 tone map from a test pattern and for altering a calibrated tone map in accordance with 

4 user entered parameters is known in the art. A "driver" which modifies a calibrated 
s tone map in accordance with user entered parameters is provided by the 

6 manufacturer with many commercially available scanners. Finally as indicated by 

7 block 358, the user modified tone map is sent to the scanner and the process 

8 proceeds as indicated in block 303 in Figure 3A. 
9 

10 The preferred embodiment of the invention described above relates to enhancing the 

1 1 operation of a watermark detection program. The invention could be similarly applied 

12 to enhancing the operation of programs such as programs the detect geometric 

13 shapes such as logos or particular patterns in an image. Likewise the invention could 

14 be applied to enhancing the operation of feature extraction programs, such as 

15 program for face recognition, fingerprint detection etc. In all these cases the inverse 

16 user adjustment program 25 would reverse any changes made as a result of settings 

17 entered by the user. 

18 

19 In embodiments that use shape or image recognition the watermark detection program 

20 26 would be replaced by an image or shape recognition program. Alternatively, a 

21 shape or image recognition program could be provided in addition to watermark 

22 detection program 26 and the output from both such programs would determine the 

23 action taken by control block 316. 
24 

25 In an alternate embodiment of the invention, a special tone map is developed with the 

26 specific object of enhancing the ability to read a watermark and to detect shapes in a 

27 digital image which has been scanned. This special tone map is developed in order to 

28 reverse artifacts introduced into an image by a scanner. The special tone map is then 

29 either directly applied to the image generated by a scanner or the user adjustment 

30 program reverses any changes made to the image that differ from the values in the 

31 special tone map. 
32 

33 An overall flow diagram for an alternate embodiment of the invention is shown in 

34 Figures 4A to 5D. The embodiment shown in Figures 4A to 5D, takes into 

35 consideration the fact that the transfer function of a printer or scanner may differ in the 

36 x and y directions. The process begins with a digital image 420A. A watermark is 
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1 introduced into the image by a watermarking program 421 . The watermarking 

2 program 421 may for example be the commercially available program "Adobe 

3 PhotoShop" which is marketed by the Adobe Corporation. The watermarked image is 

4 then printed by a printer 422 resulting in a watermarked physical image 420B 

5 

6 The image 420B is next passed through a scanner 423 to generate a digital image 

7 420C as illustrated in Figure 4B. The scanner 423 has a transfer function S(u,v) where 

8 "u" and V are the horizontal and vertical frequency axis. Of particular importance is 

9 the fact that the transfer function of scanner 423 differs in the "x" and y directions. 

10 Furthermore, the transfer function of the scanner is separable in the V and V 

1 1 dimensions and the transfer function S(u,v) can be represented as S(u) times S(v). 
12 

13 The image 420C is passed through (or operated upon by) a transfer function 425 

14 which approximates as close as possible the inverse of the transfer function S(u). The 

15 image is passed through (or operated upon by) a transfer function 426 which 

16 approximates as close as possible the inverse of the transfer function S(v). Both of 

17 the operations 425 and 426 may be done simultaneously. The technique for designing 

18 a filter with a particular transfer function is well know. The result of passing the image 

19 through filters 425 and 426 is a modified digital image 420D. The modified digital 

20 image 420D is then passed through a conventional watermark detection program 424 

2 1 in order to detect the watermark. 

22 

23 While the above embodiment relates specifically to compensating for anomalies 

24 introduced by scanner 423, the filters 425 and 426 could likewise be designed to 

25 compensate for anomalies introduced by the transfer function of the printer 422 or for 

26 both the transfer functions of printer 422 and scanner 423. 
27 

28 The second embodiment of the invention described above relates to the use of filters 

29 which approximate as close as possible the inverse of the transfer function of a 

30 scanner. Such filters of necessity will be relatively complex. A simpler embodiment of 

3 1 the invention is illustrated in Figures 5A to 5D. 

32 

33 With reference to Figures 5A to 5D, it is specifically noted that an image has a two 

34 dimensional frequency spectrum. For convenience in illustration, Figures 5A to 5C 

35 show one dimensional frequency spectra. That is, the frequency spectrum of an 

36 image is in fact two dimensional; however, the principles can be more conveniently 
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t illustrated with a diagram that shows a one dimensional frequency spectrum. Hence, 

2 Figures 5A to 5D show one dimensional spectra; however, it should be understood 

3 that in fact they merely illustrate one dimension of a two dimensional spectrum. 

4 

5 A scanning process is of necessity a sampling process. As is well know, a sampling 

6 process produces a periodic frequency spectrum. If sampling is at a frequency F s the 

7 spectra are separated by F s as shown in Figure 5A. If the sampling frequency is too 

8 low, the frequency spectra will overlap as shown in Figure 5C. 
9 

10 In the case where the spectra do not overlap such as shown in Figure 5A, the 

1 1 compensating transfer functions 425 and 426 are designed to enhance the lower 

12 frequency components of the signal so that the spectra are relatively square as shown 

13 by spectra P1 m to P3m in Figure 5B. 
14 

15 In the situation where the scanner resolution (i.e. for example, the scanner sampling 

16 frequency in the X direction) produces a frequency spectrum such as that shown in 

17 Figure 5C, the watermark detection can be improved by filtering out frequency ranges 

18 A and B which are shown in Figure 5D. That is, the compensating transfer function of 

19 filter 225 shown in Figure 4B would be a simple frequency filter which eliminates the 

20 frequency in ranges A and B shown in Figure 5C. 
21 

22 Any printers and any scanner has a transfer functions which is particular to the 

23 particular physical characteristics of the printer. In general the manufacturer of a 

24 printer or a scanner would best understand the transfer function of a particular printer 

25 or scanner. However, if the transfer function of a printer or a scanner can not be 

26 obtained from the units manufacturer, it can be determined experimentally. The 

27 transfer function of a printer and of a scanner can be determined experimentally in 

28 various known ways. One particular technique for determining the transfer function of 

29 a printer or of a scanner is shown in Figure 6. First, a process for determining the 

30 transfer function of a scanner 642 will be described. 
31 

32 As illustrated in Figure 6, the process for experimentally determining a transfer function 

33 of scanner 642 begins with a digital image 640A. The image 640A should be printed 

34 on a very high quality printer to produce a physical image 640B which as closely as 

35 possible is identical to image 640A. The physical image 640B is then scanned by 

36 scanner 642 to produce a modified digital image 640C. 
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I 

2 Next the original digital image 640A is compared to the modified digital image 640C by 

3 a comparison program 643. Any differences between images 640A and 640C 

4 represent anomalies introduced by the scanner 642. Stated differently the image 

5 640C is image 640A modified by the transfer functions of scanner 642. In a practical 

6 situation, dozens if not hundreds of images will be passed through the process shown 

7 in Figure 6 in order to determine, as closely as possible, the transfer function of a 

8 particular scanner. 
9 

10 If one wants to determine the transfer function of a printer, a very high quality scanner 

1 1 can be used in the process illustrated in Figure 6. In such a case differences between 

12 images 640C or 640A would due to anomalies introduced by the printer. 
13 

14 It is noted that instead of using a very high quality printer or scanner as described 

15 above, one could use a printer with a known characteristic when seeking to determine 

16 the transfer function of a scanner and one could use a scanner with a known transfer 

17 function when seeking to determine the transfer function of a printer. The known 

1 8 transfer function of the printer or scanner would then be taken into account when 

19 seeking to determine the transfer function of the other component. 

20 

2) The differences detected by comparison program 643 can be used to generate a 

22 function or filter that approximates the inverse of the transfer function of a printer 641 

23 or of a scanner 642 or the differences can be used to design a compensating filter as 

24 used in the embodiment described with reference to Figures 5A to 5D. The 

25 differences in the V and "y" directions can be processed separately in order to be able 

26 to separately compensate for the differences in the x" and " y" directions. 
27 

28 While the invention has been described with respect to a number of different 

29 embodiments of the invention, it will be understood by those skilled in the art that 

30 various changes in forma and detail can be made without departing from the spirit and 

31 scope of the invention. 

32 
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1 

2 I claim: 

3 

4 1) A process and system for improving watermark detection by compensating for 

5 artifacts introduced by the printer and/or scanner through which the image has passed 

6 prior to detecting a watermark in said image. 
7 

8 2) A process or system for improving watermark detection by applying different 

9 compensation to an image in the V and V (that is, the vertical and horizontal) 

10 directions to eliminate anomalies introduced by a printer or scanner which differ in the 

n Y and "y" directions. 

12 

13 3) In a system that includes a scanner that includes a down loadable tone map, a 

14 scanner driver that includes a calibrated tone map for the scanner and user controls 

15 which control modification of said calibrated tone map to generate a user adjusted tone 

16 map, said scanner generating an image which has been modified by said user 

1 7 controlled tone map, 

18 the improvement comprising a program to reverse the action on said image of the user 

19 modifications to said calibrated tone map. 

20 

21 4) A method of reading a watermark or pattern from a digital image generated by a 

22 scanner from a hard-copy image, said digital image most nearly matching said hard- 

23 copy image when the image generated by said scanner is modified in accordance with 

24 a calibrated tone map, said method comprising, 

25 down-loading into said scanner a user modified tone map, 

26 modifying said image in said scanner with said user modified tone map, 

27 transferring said scanner modified image to a computer attached to said scanner, 

28 modifying said modified image with a tone map that reverses any differences between 

29 said calibrated tone map and said user modified tone map to generate a reverse 

30 modified tone map, and 

31 reading said watermark or detecting said pattern in said image. 

32 
33 
34 
35 
36 
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1 5) A method of controlling operations with data carried in a physical image comprising 

2 the steps of: 

3 scanning said physical image with a scanner which has an associated calibrated tone 

4 map which will compensate for differences between the image generated by said 

5 scanner and the characteristics of said physical image, 

6 adjusting said calibrated tone map in accordance with user supplied parameters to 

7 produce a user adjusted tone map, 

8 applying said user adjusted tone map to said image to produce a user desired image, 

9 applying a tone map to said user desired image which is the inverse of the changes 

10 made to said calibrated tone map to generate said user desired tone map, to generate 

1 1 an image that corresponds to the image generated by said scanner compensated by 

1 2 said calibrated tone map, 

13 reading a characteristics of said image, 

14 controlling said operations with the result of said reading step. 

15 

16 6) The method recited in claim 5 wherein said reading step reads a digital watermark 

17 from said image. 
18 

19 7) The method recited in claim 5 wherein said reading step detects a shape in said 

20 image. 

21 

22 8) The method recited in claim 5 wherein said reading step reads attempts to both 

23 read a digital watermark from said image and to and detects a shape in said object. 

24 

25 9) A method of operating on an image comprising the steps of 

26 generating a first digital image from a physical document, 

27 applying a first tone map to said image to generate an adjusted digital image, 

28 applying an second tone map to said adjusted digital image to generated a corrected 

29 digital image, said second tone map adapted to reverse an changes made to said first 

30 digital image that differ from changes specified by a calibrated tone map, 

3 1 operating upon said corrected digital image to determine characteristics of said 

32 corrected digital image. 
33 

34 10) The method recited in claim 9 wherein said corrected digital image is operated 

35 upon to read a digital watermark from said corrected digital image. 

36 
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1 11) The method recited in claim 9 wherein said corrected digital image is operated 

2 upon to detect a pattern in from said corrected digital image. 

3 

4 12) A system which includes a scanner which has the ability to apply a tone map to a 

5 scanned image, and a data source which calculates a user adjusted tone map by 

6 applying to a calibrated tone map user established parameters, said data source 

7 having the ability to down load said user adjusted tone map to said scanner, said 

8 scanner adapted to applying said user adjusted tone map to said scanned image to 

9 generate an adjusted image, 

10 an inverse user adjustment program that generates a corrected image by applying to 

1 1 said adjusted image a tone map that reverses changes made to said calibrated tone 

12 map to generate said user adjusted tone map, 

1 3 program for detecting characteristics of data in said image. 

14 

15 13) The system recited in claim 12 wherein said program for detecting characteristics 

16 of data in said image comprises a watermark reading program. 

17 

18 14) The system recited in claim 12 wherein said program for detecting characteristics 

19 of data in said image comprises a program for detecting shapes in said image. 

20 

21 15) A system for operating on an image comprising 

22 an image acquisition device for generating a first digital image from a physical 

23 document, said image acquisition device applying a first tone map to said image to 

24 generate an adjusted digital image, 

25 an inverse user adjustment program for applying a second tone map to said adjusted 

26 digital image to generated a corrected digital image, said second tone map adapted to 

27 reverse an changes made to said first digital image that differ from changes specified 

28 by a calibrated tone map, 

29 a program which operates upon said corrected digital image to determine 

30 characteristics of said corrected digital image. 

31 16) The system recited in claim 15 wherein said program which operates upon said 

32 corrected image is a watermark reading program. 

33 

34 17) The system recited in claim 15 wherein said program which operates upon said 

35 corrected image is a program which detects particular shapes in said corrected image. 
36 
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1 18) A system for operating on an image comprising 

2 acquisition means for acquiring a first digital image from a physical document, said 

3 acquisition means applying a first tone map to said image to generate an adjusted 

4 digital image, 

5 means for applying a second tone map to said adjusted digital image to generated a 

6 corrected digital image, said second tone map adapted to reverse an changes made to 

7 said first digital image that differ from changes specified by a calibrated tone map, 

8 detection means for operating upon said corrected digital image to determine 

9 characteristics of said corrected digital image. 
10 

1 1 19) The system recited in claim 18 wherein said detection means comprises a 

12 watermark reading program. 
13 

14 20) The system recited in claim 18 wherein said acquisition means is a scanner. 

15 

16 21) The system recited in claim 18 wherein said detection means comnprises a 

17 program to detect a shape in an image. 

18 

19 22) A method of acquiring a digital image from a physical document, 

20 scanning said image with a scanner to produce a digital image, said scanner 

21 introducing aliasing frequencies into said digital image, 

22 filtering said image to eliminate said aliasing frequencies to produce a corrected digital 

23 image. 
24 

25 23) The system recited in claim 18 wherein said acquisition means is a ScanJet 6300c 

26 scanner. 
27 

28 24) A method of creating a digital image that corresponds to an image on a physical 

29 document, 

30 scanning said physical document with a scanner to produce a first digital image, the 

3 1 frequency response of said scanner decreasing at higher frequency values, 

32 filtering said first digital image with a filter which compensates for the frequency 

33 response of said scanner. 

34 
35 
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1 25) A system which includes a TWAIN compliant scanner which has the ability to 

2 apply a tone map to a scanned image, and a TWAIN data source which calculates a 

3 user adjusted tone map by applying to a calibrated tone map user established 

4 parameters, said TWAIN data source having the ability to down load to said scanner 

5 said user adjusted tone map, said scanner adapted to applying said user adjusted 

6 tone map to said scanned image to generate an adjusted image, 

7 an inverse user adjustment program that generates a corrected image by applying to 

8 said adjusted image a tone map that reverses changes made to said calibrated tone 

9 map to generate said user adjusted tone map, 

10 a computer program for which examines characteristics of said corrected image. 
II 

12 26) The system recited in claim 25 wherein said program is adapted to read a digital 

13 watermark in said image. 

14 
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